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ABSTRACT 

In this research project, the problems studied were 
as follows: (1) Are there differences in scanning patterns between 

preschool children who show Positional Response Sets (PRS) and normal 
adults? (2) Do the techniques utilized in "An Exploration of PRS in 
Disadvantaged children and a Technique for Reduction of Such Sets" 
change scanning patterns? and, (3) Do these techniques change PRS 
behavior as was shown in previous work? The subjects (40 preschool 
children from low-income areas of New York City) were shown a 
quadrant Chinese letter array, and eye movement patterns were 
monitored by an Eye Movement Recorder. Subjects were then given 
training in a technique designed to encourage scanning through entire 
arrays. Following training, subjects were again recorded as to eye 
movement patterns and retested on the Chinese Letter Naming Task. In 
terms of directly changing scanning behavior, evidence of the 

ficacy of the training procedure is absent. Whether or not training 
- sdures similar to the one used here can produce changes in 
*■ nning remains to be seen. [Final report, December 1969, which 
included in this document, is substantially the same as document 
039 268, except for appended illustrative material. ] (Author/JW) 
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ABSTRACT 



Victor (1969) showed that Positional Response Sets (PRS) in 
multiple-choice type tasks occurs frequently among preschool dis- 
advantaged children, but that this tendency was modified through a 
brief training procedure. The effect of training also transferred to 
a situation using the same array arrangements, but different stimuli. 
While it does appear that the techniques have an effect on positional 
response sets, it is possible that effects are stronger than those 
measured. Since positional response sets may or may not be .indicative 
of inadequate scanning behavior, analysis of eye movement behavior can 
tell us whether or not scanning is changed by use of the training tech- 
niques previously developed. 

The problems with which this project is concerned are as follows: 

1) Are there differences in scanning patterns between preschool 

children who show PRS and normal adults? 4 .... 

2) Do the techniques utilized in "An Exploration of Positional 
Response Sets in Disadvantaged Children and a Technique for Reduction 
of Such Sets" change scanning patterns? 

3) Do these techniques chanfe PRS behavior as was shown m the 

previous year's work? 

Forty children of pr’eschool age obtained from Day Care Centers in 
low income areas of New" York City were chosen from a larger sample of 
children who were tested with the Chinese .Letter Naming Task. lhis 
task is an unsoluable, multiple choice test and criterion for selection 
was the presence of PRS as determined by chi-square analysis. 

These subjects were then shown a quadrant Chinese letter array and 
eye movement patterns were monitored by an Eye Movement Recorder. Sub- 
jects were then given training in a technique designed to encourage 
scanning through entire arrays. Following training subjects were again 
recorded as to eye movement patterns and retested on the Chinese Letter 
Naming Task. 

This reserach has supported the bindings of the previous year in 
regard to the efficacy of special training procedures in eliminating 
PRS in low SES preschool children. While the pattern of positional 
choices was different in this sample than for the previous year's 
sample, training worked as well if not better. Although the experimen- 
tal treatment had an effect on both the deviation score and the number 
of PRS subjects, the group pattern remained non random even thought some 
pattern change was apparent. The group pattern, however, cannot be con- 
sidered seriously unless a much larger sampling was taken. In this 
regard it is obvious that there are many individual differences in the 
particular pattern of preferences and avoidances. 



O 

ERIC 



2 



In terms of directly hanging scanning behavior, evidence of the 
vfficacy of the training procedure is absent. few preschool children 
»ver showed tlie correct scanning sequence, even at post test time. One 
reason which might partially account for the failure to Improve scanning 
nay be the dissimilarity between the training condition and tlie test 
condition . 



to the one used here can 
Too many variables inter- 
record children of ' 1 s age at a.L.1 
all confident that v t information 



Whether or not training preocedures similar 
produce changes in scanning remains to he seen, 
vened in our experience. Being able to 
was 8 severe problem, and we are not at 
we do have is accurate. This uncertainity must exist because of the sensi- 
tivity of the instrument, the difficulty of achieving proper alignment, and 
the great loss of accuracy caused by even the slightest postural changes m 
the subject 
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HRIKI* DESCRIPTION OP PROJECT 

II; is generally assumed that when a group of respondents have 
]io information concerning a set of multiple choice questions, theie 
is an equal probability that any of the ”k" choices will be selected. 

Many test constructors and evaluators, therefore, institute a 
correction for "guessing” formula under the assumption that in any 
test, several items may be checked correctly by mere chance. Given 
”n” items and "k” choices for each of the "n" items, the number of 
correct guesses expected by chance is readily obtainable and may be 
taken into considei' , aition in correcting the score for each respondent, 
from the total number of correct responses. 

There has been a great deal of literature in psychology and 
education dealing with "response sets"--tendencies among individuals 
or groups to select certain types of responses so that if the choices 
were presented in some other form, a differed- 1 ' woi Ld uav<* 

boon sexected. 

However, mmch of this research concerns response sets for 
judgment categories in scaling problems, and little attention has been 
CTiven to response sets in irrultijjle— choice situations. Indeed Cronbach 
( 19 h 6 ) claimed that the multiple-choice pattern is free from response 
sets . 

A type op response set to which multiple-choice type items wculd 
be prone and nat has been relatively ignored is positional response 
sets. While such response sets may not play a strong role in testing 
adults, we have found strong positional response set tendencies, over 
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a. variotv ol tests which we have hear constructing (Early Childhood 
Inventories) , in pre-school aged children. 

Sue]) tendencies must play a strong role in the scoring and inter- 
pretation of tests for young children. This problem is most acute when 
tests are to he used diagnostically. If a teacher is interested in 
which colors a child does and does not know on a receptive level, the 
child is typically presented with arrays of size k and is asked to choose 
the color which. the tester names. If positional response sets play a 
role , then those items whose correct choice is in a favored position 
will have a greater probability of being chosen than those items where 
the correct choice is in a less favorable position. Under such condi- 
tions, therefore, the question of which colors the child knows receptively 
cannot be adequately answered. 

A child showing such positional response sets is very likely to be- 
displaying a lack of adequate scanning behavior. Evidence to support 
this view is given : the finding that response sets tend to occur in the 

first position in young children. This finding suggests that their 
scanning is only partial and may be a function of lack of searching for 
the correct response. If children are given special experience in suc- 
cessful scanning, it may be possible to reduce the positional sets, thus 
providing truer measures of the child’s ability. 

In the previous year’s work, ”An Exploration of Positional Response 
Sets in Disadvantgaed Children and. a Technique for Reduction of Such 
Sets,’’ evidence was obtained which indicated that methods designed to 
encourage scanning significant affected group performance. While such 
training did have an overall effect in reducing the magnitude of posi- 
tional. response set behavior (PRS) , the appearance of a response set 
O 
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itself may not always indicate a lack of adequate 
also be accounted for by a second factor which we 



scanning. 



•term motor 



PRS couJ d 
persistence . 



This behavior might be especially manifested in situations where the 
subject has little knowledge regarding the test items. The resultant 
behavior may be merely a decision by the subject to limit his responses 
to particular positions. 

On the other hand, nondetection of positional response sets in 
some subjects may not be indicative that adequate scanning is -taking 
place. A subject may decide to choose a different position on each item 
but choose theposition with disregard to the other items. This behavior 
would be similar to closing ones eyes and "pinning the tail on the 



donkey." 

The crucial question then, is whether the scanning training has 
changed the ‘ ’■' : ects scanning behavior when presented with the test 
arrays. Subjects who show only "motoric." positional response sets are 
not a problems since they already are scanning adequately and if present- 
ed with a soluble problem or one in which they have knowledge they would 
most likely respond appropriately. On the other hand, subjects who show 
no positional response set on the pretest may really have poor scanning 
ability which was improved by the training but not picked up by analyzing 
their positional response behavior. What we are suggesting is that the 
training may have been even more effective than the results of the study 
will indicate, positive as they seem. More subjects than were detected 
may have shown improvement in scanning due to training and subjects 
with response sets who indicated no improvement may not have had any 
problem to begin with. To investigate this problem a more direct measure 
of scanning is called for. 
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Thc problems with which this project is concerned are as follows 

1) Are there differences in scanning patterns between preschool 

children who show PRS and normal adults? 

2) Do the techniques utilized in "An Exploration of Positional 
Response Sets in Disadvantaged Children and a Technique for Reduction 
of Such Sets" change scanning patterns? 

3) Do these techniques change PRS behavior as was shown in the 

previous year’s work? 
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HETIIObOLOCY 



Sub j oc t.s 

The subjects consisted of forty children of preschool age ob- 
tained from Day Care Centers in low income areas of New York City. 

The children were selected from a larger group of children who were 

administered the Chinese Letter Naming Task. The criterion for 

2 

inclusion was a significant X indicative of the presence of PRS and 
a willingness by. a child and parent to takepart in further experimen- 
tation. Subjects who showed a great deal of restlessness were also 
eliminated from the sample as adequate recording of eye movements was 
impossible. The original design had called for 30 males and 30 females, 
15 E and 15 C of each sex. Because of some of the reasons mentioned 
above and some further complications (e.g., overexposed and under- 
exposed film, failure to participate in post test), only IT females 
(6 E and S C) and 26 males (14 E and 12 C) constituted the final sample. 
Almost all of the children were of Puerto Rican background and all were 
of low SES. 
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Material s and Procedures 

Pro to st 

All subjects were given a 32 item, four choice Chinese Letter 

Naming Task. The four choices were arranged in quadrants, and were 

presented to S individually by E in a booklet. The children were 

asked to look at the four choices and select the one which they 

2 

thought was the "real" Chinese letter. 

Subjects who showed PRS were then individually taken to the 
laboratory within one to two weeks after the Chinese Letter Naming 
Task was administered. Subjects wore seated before the Eye Movement 
Recorder V-1164, amnuf actured by die Polymetric Company. He sat, 
head fixed on a bite plate, teeth planted in dental wax. The subject 
looked through a lens tube at a field shown on a target card (a 
diagram is included in the appendix) . 

The subject first fixated on the nose of a clown in order to 
correctly allign the apparatus. Following the clown, 1 the subject 
was shown a four choice Chinese letter array similar to those in the 
Chinese Letter Naming Task. We had originally intended to use two 
such arrays and two other linear arrays. However, it was difficult 
for such young subjects to maintain adequate posture for more than 
a brief period of time. Henee, only one array, a quadrant, was 
exposed for 15 seconds. Following the presentation of the critical 



Half of the letters were chosen from pilot testing which indicated that 
subjects from the same background as those used in the experiment neither 
favored nor avoided those particular letters. (Victor, 1968). The remain- 
ing letters consisted of the chosen letters turned upside down. 

2 

It was necessary to utilize an insoluble task because we were interested- 
O ! a ■ pure guessing pattern. 
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stimulus, the clown was again presented to determine what drift bad 
occurred. Where drift was severe the subject was eliminated. While 
the critical stimulus was shown, a Beaulieu 16MM movie camera recorded 
the subject’s eye movements as reflected through a mirror onto the 
target at a speed of eight frames per second. 



Training 

Experimental : 

Experimental subjects were shown four choice arrays of 16 sets of 
pictures and symbols. Twelve of these were readily identifiable and 
easy to discriminate for the age group involved. The remaining four 
were difficult for the age group in order to produce a few errors and 
make a second trial logical. In trial one, subjects were shown the 
pictures exposed through a sliding window, containing four openings, 
which E slid across the page in the linear array, exposing one picture, 
then two, then three and then all four in a left-right sequence. For 
the quadrant array, two sliding windows were used, each having two open- 
ings. They were placed across the quadrant arrays, one above and par- 
allel to the other. First, the top left window was exposed by E and then 
the top right. Finally, the bottom windows were exposed to Show the 
remaining two pictures. Hence, both exposure sequences resembled adult 
reading patterns (left to right, or top left to right and then bottom 
left to right) . E also instructed S in both procedures to look at all 
of the pictures before choosing one. 

Contro l ; 

Control subjects were shown single pictures and asked to name 

O 
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them. The single pictures were the critical items from the exper- 
imental training procedure. Again two trials were used. 

Post Test 

Immediately following the training session, a post test of the 
original Chinese Letter Naming Task was administered to both 'E and C 
subjects . Immediately following the post test the subject was again 
seated at the Eye Movement Recorder and photographed under the same 
conditions as in the pretest. 
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FINDINGS 

Table 1 shows 'the distribution of choices among the four positions 
for each subject on the pretest and post test of the Chinese Letter 
Naming Task. The table also shows the deviation score which is obtained 
by the following formula: (0-E) , where 0 equals the obtained frequency 

of responses for any position and E equals the exp oted frequency of 
^responses f r any position. Since there were a_iwa' 3 four positions ai„d 
32 test ite 3 , E was always equal to 8. The us a ci these deviation sc ores 
enable us t ri express the amount of PRS quantitati* sly. 

At post test 14 E subjects and only 7C subjects improved to per- 
formance showing no significant deviation from random guessing. While 

these results indicate support from the previous year’s finding, the 

2 

percentage of children who improved to nonsignificant X levels was 
greater here. However, in the current population, only children who show- 
edPRS on the pretest were used. From the control group data it can be seen 
that with such a population some scores will improve with no specific 
training. The E group, however, showed twice as many changes to non- 
significant patterns. 

2 

Table 2 shows the X number and percent responses per position for E 

. 2 

and C subjects on the pretest and post test. The X for the preLest 

2 

group results was significant for the E group (X = 29.44; p . OOj.) , the 

2 . . 

C group (X = 42.24; p .001) and of course for the E and C group combined 

2 ' , . , 

(X = 67.94; p .001). It can be seen from the distribution tnat subjects 

tended to prefer the top 3.eft position (3S%) . This finding is in contrast 

to the finding of the previous year’s study in which the top left position 
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v;as chosen less frequently than any of the other positions. The lower 

left position, which was the most popular choice in the previous study 

(Victor, 1970) was chosen approximately as often as the lower right 

position. Following training, a shift in behavior occurred foi the E 

group whereby the top left position was no longer favored much (30%) 

and in which there was a reduction in choices for the bottom r. ,.gi posi- 
2 • 2 

tion. X ns significant (X = 13.35; p .01), but less so tnan r pro- 
test. The C group actually showed a greater disparity in chc.- 'c-s by 

2 

position than on .the pretest (X = 6a.89j p .001) . The prepon.de.. =.nce -f 
choices in the top left position remained, but there was a great, reduction 
in the number of choices of the bottom right position and a com 1 iida.„. 
increase in choices of the upper right position than was found -n the 
pretest. 

Table 3 shows the Means and Standard Deviations of the deviation 
scores for the pretest and post test. The E and C groups are not equal 
in regard to pretest deviation score means. The E group shows more 
extreme PRS behavior than does the C group. Nevertheless, at post test, 
the C group evidences virtually no change from pretest level while the 
E group improves to such an extent that the difference between it and the 
C group is as great at post test in the direction of the E group as was 
twice in the pretest where the direction indicated better C group per- 
formance. 

Table 4- shows the analysis of covariance of the post test scores 
with pretest scores as the covariate. The F does not reach significance. 
A likely critical factor was the great variance of the groups as seen in 
Table 3. In fact, the standard deviation of the E post test was nearly 
as large as the mean. Another way to look at. the efficacy el _ie _rain- 
O 
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ing procedure is to examine the number of subjects in each treatment- 

group who showed positive and negative or no change from pre to post- 

test in terms of deviation score. As seen in Table 5, IS of the 20 

subjects showed improvement while only 9 of the 20 subjects evidenced 

reduced deviation socres. A X test for two independent samples, however 

2 

indicated that X was slightly below the necessary significane level 



(X ■ 2.60) . 

The results of the scanning part of our study are shown in J. able 6. 
Indicated here is- whether or not the correct sequence namely top left 
to top right to bottom left to bottom right was evidenced in the film 
records of the subjects. We felt that only this gross measure could be 
utilized to tell us much about scanning performance. Time per position 
was not considered an altogether useful measure because subjects might 
select out after a brief scanning some of the choices for consideration. 
Rememberthe subject's task was to choose one of the four. We felt then 
that whether or not the correct sequence appeared would give us enough 



information regarding the efficacy of the training for scanning behavior. 
Only the first 10 seconds (or 80 frames) were analyzed. From Table 6 it 
is apparent that most adults do tend to use the correct sequence during 
the course of their scanning. There were two exceptions among the 
adults. . One subject tended to scan in a box like fashion. The other 
subject showed no particular pattern, but avoided the bottom left posi- 
tion until over 5 seconds had elapsed. In contrast to the adult pattern, 
only 2E and 2C subjects showed correct sequence scanning on pretest. On 
the post test 5E’s and SC's showed the correct sequence. 
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CONCI.IJS IONS 



This research lias supported the findings of the previous year 
in regard to the efficacy of special training procedures in eliminating 
PRS in low SES preschool children. While the pattern of positional 
choices was different in this sample than for the previous year’s 
sample, training worked as well if not better. Although the experimental 
treatment had an effect on both the deviation score and the number of PRS 
subjects, tlie group pattern remained non random even though some pattern 
change was apparent. The group pattern, however, cannot be considered 
seriously unless a much larger sampling was taken. In this regard it 
is obvious that there are many individual differences in the particular 
pattern of preferences and avoidances. 

In terms of directly changing scanning behavior, evidence of the 
efficacy of the training procedure is absent. Few preschool children 
ever showed the correct scanning sequence, even at post test time. One 
reason which might partially account for the failure to improve scanning 
may be the dissimilarity between the training condition and the test 

j- condition. In pilot testing during the previous year’s work, it was 

i 

found that training where a box with sliding windows was used instead 
of using the sliding windows directly on the booklets produced little 

f- 

I effect. The novelty of the box in the former case and the Eye Movement 

Recorder in the present case may have detracted from the learning, 
although the box in the previous study was a training procedure and the 

i 

Eye Movement Recorder is a test procedure, the same principle may have 

: 

been operating. If the training procedure could have been arranged in 
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h sottii j, mu ;ii:..ilar to flu nye movement- recording procedures, more 
s icoess in. glit have been obtained . Whether ">v not training procedures 
irnilar tn the one used here an produce changes in scanning remains to 
1 e seen. Too many variables intervened in our experience. Being able 
to record children of this age at all was a severe problem, and we are 
■ot at all confident that what information we do have is accurate. This 
uncertain ily must exist because of the sensitivity of the instrument, 

-he difficulty of achieving proper alignment, and the great loss of 
accuracy caused by even the slightest postural changes in the subject. 

We have discovered a technique which does improve PRS. At this 
time, however , it is not possible to ascertain why. If the procedure 
dees not work through the improvement of scanning, then perhaps it 
works through the information given to the child that the correct 
choice can occur in more than one position. If so, an experiment 
could be set up which would give the subject this information, but 
would involve minimal scanning training. At any rate, training child- 
ren effectively to scan in the proper sequence would probably involve 
a much greater degree of training than the IQ minute procedure under- 
taken here. 



O 

ERIC 



16 



REC OMMENDAT IONS 



1. Further research should he undertaken in respect to the 
following related problems: 

a) To determine the generality of the findings regarding the 
degree and pattern of positional response set behavior with children 
of other background and SES characteristics. 

b) To determine whether PRS behavior is a function of scanning. 

PRS Ss should be examined as to eye movement patterns in relation to 
eye movement patterns of good scanners. 

c) To develop methods to produce more extensive changes in test- 
related scanning skills. 

d) To determine the extent and pattern of positional response sets 
with other array arrangements and sizes. 

e) To determine whether mere awareness that the correct . answer can 
occur in any of the four positions can significantly change PRS. 

f) Whether PRS is related to performance on language or pre read- 
ing skills which have a visual component. 

2. The results of our investigation imply that positional sets 
are very common among low SES, preschool age children. Since this 
behavior may 'reflect the lack of adequate scanning by these children, 
these findings have important implication for preschool programs, 
especially in reference to prereading skills and test taking skills. 

It is possible that low scores on tests by these children, when such 
tests involve multiple choices, may reflect not so much a cognitive 
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doficit, but, ratlier, an inadequate registration of the choices offered. 
If a child is not adequately registering information appearing on a 
p age then reading cannot take place. Perception must pi ccode cognition. 



3. Given the problem outlined above, remedial steps can be 
taken and should be incorporated into preschool curricula* A step in 
this direction could be more extensive use or some adaptation of the 
training methods utilized in the current stuay. fhe method lias the 
advantage of training the children to look at all of the choices in a 
manner which reinforces the correct scanning patterns for reading in 
the English language, that is, from left to right. It should be point- 
ed out that our training did not produce a strong enough change insofar 
as changes in number of PRS Ss. However, distributed practice over a 
longer period of time could produce the desired change. After all, 
our training period entailed only one, ten minute session. 

i\. a Test users and cosntructors should be aware of PRS- One 
technique used by this investigator in the Early Childhood Inventories 
(C oiler and Victor, 1967) , is to utilize a second form of a test in 
which the same choices are given, but their positions changed. If a 
child Is correct on both, we can be reasonably sure that the answer Is 
known. This procedure Is desirable for diagnostic testing. Othei 
procedures might utilize some instructional procedures to emphasize to 
the children the need for looking at all choices. A sliding window 
technique , for example, could be, used for sample Items prior to the 

test. 
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5. IF the investigator is interested in eye movement' locations 



(os we were), rattier than such other variables as Fixations 



regressions 




such data from children of this age and SES level. Perhaps a more direct 



method of registering corneal movement would be more desireable . How- 
ever, there could be a problem creating discomfort by such a procedure 
in children this young. In any event, it is difficult to expect that 
parents of children from oar population would allow their children to 
undergo such procedures. 
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2 

x , 


Number and Fe 
Hulrjee tf: 


iropjil" 

; on p. 




Pos:i 


LI' ion A 


Fof i 


’ 1 i on 


■etest : 










E 


213 


(33%) 


117 


(18%) 


C 


231 


(36%) 


133 


. (21%) 


.1 S 1 s 


44 4 


(3- oO 


250 


(19%) 


sttest : 
E 


195 


(30%) 


159 


(25%) 


C 


235 


(37%) 


174 


(? 7%) 


1 S 1 s 


430 


(33%) 


333 


(26%) 



*, p *<;. 01 = 11.34 
** p <=.001 = 16.27 
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TABLE 2 

: j sponses per Position for E and C 



st and Pastiest 
Position C Position D 


2 

V 


154 (24%) 


156 


(24%) 


29. 44 


141 (22%) 


135 


(21%) 


42.24 


295 (23%) 


29] 


(23%) 


67.94 



157 


(25%) 


130 


(20%) 


13, 


.35 


135 


(21%) 


96 


(15%) 


65. 


.89 


292 


(23%) 


226 


(18%) 


68. 


.40 
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TABLE 3 



Means and Standard Deviations of Deviation Scores by 
Treatment and Tost Period (N = 2 0) 



Pretest 



E 

C 



X 



20.8 



S . D , 

13.03 

8.34 



Posttest 
X S.D. 



15.4 

20.2 



14. 75 
14.3 6 




i 



i. 

5 " 

P 
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TAELE M 



Analysis of Covavinnco for Deviation Scores 
of K vs. C Subjects 



Source 



Total 



Error 



Treatments 



SS df MS F 

7072.36 3 S 

6558. ‘10 37 177.25 

513.96 1 513.96 2.90 



. 05 



F 



M . 08 



P 
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TABLE 5 



Distribution o:l; E and C Subjects Who Si 1 owe d 
Pre-Post' Improvement (-I-) , Loss (-) or No Change (0) 



+ 



0 



E 



15 



3 



2 



C 



9 



7 . M 



x 2 = 2.60 

x 2 = 2.71, p . 01 (one-tailed) 
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TABLF. G 



Afjpearnnce (+) or Ah sense (-) of Correct Sequence of Movements 
on Rye Movement Recorder 



Adults 8 

(n = 10) 

Children Pretest 

(n=20) + 

E 2 

C 2 



2 

Po stte st 

- • + - 

18 5 IS 

18 3 17 
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ABSTRACT 



Positional response sets i PRS ) , to which multiple-choice type 
items are prone, have been reivti' ely ignored in test construction 
and interpretation. There is evidence indicating that children have 
strong PRS tendencies, thcucfh inch sets may. not play a strong role 
among adults. Svr..dence further s aggests that PRS may indicate a 
lack of adequate scanning behavior. 

The problems with which this study is concerned are as follows: 

(1) Given two commonly uaefi four-choice array arrangements 
administered to disadvantage. c. mildren , what are the positional 
response patterns for each’cf trie arrays, when information is not 
available to the respondent? 

(2) Do age and sex variables affect positional response ten- 
dencies in disadvantaged children? 

(3) Can techniques be devised which can reduce the strength 
of the response sets? 



One hundred twenty-eight Ss of preschool age and of low SES 
backaround were tested by means of an unsolvable multiple choice 
test' the Chinese Letter Naming Task. E subjects were given train 
ing in a technique designed to encourage scanning through entire 
arrays. E and C Ss were then retested either £ollov;ing training 
or, as in the case of the C group, following an interpolated task 
Ss were then given a second "unsolvable" multiple choice task, 
that of recognizing flags of different nations. 



The main results are: (1) positional response set behavior^ 

occurs with great frequency among preschool, disadvantaged children, 
and this behavior is subject to modification by training; (2) charac- 
teristic group patterns emerge when scores are combined; (3) sex of 
S seems to have some effect on the patterns obtained; (4) age seems 
.to strongly influence the probability of occurence of PRS So; 

(5) utilization of a procedure in which Ss are given training in . 
scanning arrays similar to the test arrays, resulted in significant 
alteration of guessing patterns in relation to the patterns of groupa 
not similarly trained; and (6) the effect of the training procecureo 
on choice oatterns on the Chinese Letter Naming Tas’c transferee to 
the situation utilizing the same array arrangements, but different 
stimuli (flags) 0 • 



The facts that PRS occurs frequently among low SES, preschoo 
children and that PRS may be caused by inadequate perusal of the 
stimulus field (thereby leading to a lack of registration of all 
the choices) , have important implications for preschool programs. 



1 



0 

ERIC 



23 



— 2 



especially in reference tc re-reading and test- taking skills. It 
is possible that low s ceres* try these children on tests involving 
multiple choice rnay reflect not so much a cognitive deficit, but, 
rather, an inadequate rec_- : " ntion of the choices offered. If a 
child is not adequately r . -coring information appearing on a 
page, reading cannot tale ice — perception must precede cogni- 
tion. Given the problem :r-_ Lned above, remedial steps can be taken 
and should be incorporate! Into preschool curricula. 
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BRIEF DESCRIPTION OF PROJECT 

It is generally assumed that, when a group of respondents have 
o information concerning a set of multiple- choice questions, there 
s an equal probability that any of the "k" choices will be selected. 

Many test constructors and evaluators, therefore, institute 
. correction for "guessing" formula under the assumption that, in 
ny test, several items may be checked correctly by mere chance, 
liven "n" items and "k" choices for each of the "n" items, the mm- 
>er of correct guesses expected by chance is readily obtainable and 

l 

lay be taken into consideration in correcting the score for each, 
espondent from the total number of correct responses. 

There has been a great deal of literature in psychology and 
iducation dealing with "response sets" — tendencies among individuals 
>r groups to select certain types of responses so that, if the 
:hoices were x^tesented in some other form, a different response 
rould. have been selected. 

However, much of this research concerns response sets for 
judgment categories in scaling problems , and little attention has 
>een given to response sets in multiple-choice situations. Indeed, 
:ronbach (1946) claimed that the multiple-choice pattern is free 
:rom response sets. 

A type of response set to which multiple-choice type items 
/ould be prone and that has been relatively ignored is positional 
response sets. Vvhile such response sets may not play a strong role 
Ln testing adults, we have found strong positional response set 
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tendencies over a variety of tests which v/e have been constructing. 

Early Childhood Inventories (ECl) , for children of preschool age. 

Such tendencies nust play a strong role in the scoring and 

interpretation of tests for young children. This problem is most 

acute when tests are to be used diagnostically . If a teacner is 

interested in which colors a child, does and does not know on a 

receptive level, the child is typically presented with arrays of 

size "k" and is asked to choose the color which the tester names. 

If positional response sets play a role, then those items whose 

correct choice is in a favored position will have a greater proba— 

* 

bility of being chosen than those items where the correct choice 
is in a less favorable position. Under such conditions, therefore, 
the question of which colors the child knows receptively cannot be 

adequately answered. ' ‘ 

A child showing such positional response sets is very likely 
to be displaying a lack of adequate scanning behavior. Evidence to 
support this view is given in the finding that, on ECX protocols , 
response sets tend to occur often in young children. This finding 
suggests that their scanning is only partial and- ir.a.y be a function 
of lack of searching for the correct response. If children are 
given special experience in successful scanning, it nay be possible 
to reduce the positional sets, thus providing truer measures of the 

* V 

child's ability. 

The problems with which this project is concerned are as 
follows: 

(1) Given two commonly used four-choice array arrangements 
administered to disadvantaged children, what are the positional 
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response set patterns for each of the arrays, when information is 
not available to the respondent? 

(2) Do age and sex variables affect positional response ten- 
dencies in disadvantaged children? 

(3) Can techniques be devised which can reduce the strength 

of the response sets? 

By determining the positional response set behavior of young 

children, test constructors will be in a position to constryict 

more valid instruments or test procedures (e.g., most of the Early 

Childhood Inventories consist of two similar forms, both of which 

* 

are administered to young children who are prone to positional 
response set behavior) . A technique which can be used to reduce 
response sets by creating appropriate scanning behavior would 
result in more valid data. This, in turn, would enable educators 
to more effectively diagnose the child’s ability and plan remedial 
curricula. 

.It is suggested here that positional response sets may be 
caused by inadequate perusal of the stimulus field, thereby leading 
to a lack of registration of all the choices. The technique utilized 
here combines three types of instructional aids: 

(1) verbally telling the subject to look at all positions; 

(2) guiding the child to look at the arrays in a consistent 
and systematic manner and in such a way to be consonant with the 
development of appropriate English language reading skills (left 
to right, or left to right and then down to the next line and left 
to right) ; 

(3) through the training series, showing the child that a cor- 
rect ansv/er can occur in more than one position. 

♦ * 

o 
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METHODOLOGY 



Subjects 

One hundred tv.’enty-eiyht subjects v.’ere utilized. Sixty-four 
of these subjects served as subjects in the linear array condi- 
tion and the other 6 4 served as subjects in the quadrant condi- 
tion. Half of the linear and half of the quadrant subjects were 
given the experimental treatment. The remaining subjects acted as 
controls. Half of the experimental subjects in each array condi- 
tion were male, as were half of the control subjects in each array 
condition. The children ranged in age from 4-6 years . 1 All subjects 
were of low SES . 



Materials and Procedure 

Pretest 

All subjects were exposed to 24 four-choice Chinese Letter 
Naming Task items. For the linear array, the letters were arranged, 
each choice in a box, with the choices appearing in a left-right 
linear arrar.genent. For the quadrant array Ss, the four choices 
were arranged, also each in a box but in a quadrant arrangement 
(each box appearing toward one of the four corners of the page) . 

The letters were drawn on waliboard with magic marker. All the 



" Since birth dates of the Ss were difficult to obtain beforehand, 
age groupings were determined later. For the linear array Ss, 17 
Es were in the younger age group and 15 in the older group. Half 
the linear Cs were in the older group and half in the younger group. 
For the quadrant arrays 14, Es belonged to the older group and only 
11 Cs; .while IS Es and 21 Cs were in the younger age group. 



Thirty- two of the letters were chosen from pi lot- testing 
indicated that Ss, from the same background as those used in 
experiment ,' neither favored nor avoided those particular 1 
y ctor, I960). The remaining letters consisted of some of 
I KJCtcrs. placed upside down. 
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boxes were equal in size, and the sizeof the letteirs were also 

approximately equal. Items were presented to S by having £ expose 

the boards, one by one, as if turning the pages of a booklet. The 

children were asked to look .at the four choices and select the 

3 

one which they thought was the ‘'real" Chinese letter. 

Training 

Experimental : 

Experimental subjects were shown four— choice arrays of 16 
sets of pictures and symbols. Twelve of these were readily iden- 
tifiable and easy to discriminate for the age group involved. The 

t 

remaining four were difficult for the age group in order to pro- 
duce a few errors and make a second trial logical. In trial one, 
subiects were shown the pictures exposed .througn a sliding win- 
dow, containing four openings, which E slid across the page in 
the linear array, exposing one picture, then two, then three and 
then all four in a left-right sequence. For the quadrant array/ 
two sliding windows were used, each having two openings. They 
were placed across the quadrant arrays, one above and parallel 
to the other. First, the top-left window v;as exposed by E and 
then the. top-right. Finally, the bottom windows were exposed to 
show the remaining two pictures. Hence, both exposure sequences 
resembled adult reading patterns (left to right, or top-left to. 
right and then bottom- .left to right) . E also instructed 5 in 
both procedures to look at all of the pictures before choosing one. 



J It was necessary to utilize an unsolvable task because we were 
interested in a guessing pattern. 
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Control ; 



Control subjects were shown single pictures and asked to 
name them. The single pictures were the critical items from the 
experimental training procedure* Again two trials were used* 

Posttest 

Exeictly the same as Pretest* 

Transfer 

In order/ to see whether the changes that occurred in the 
response, patterns for the Chinese Letter Marring Task v;ould be 

v 

maintained in a different situation, a second task was presented. 
Arrays of flags of different countries were presented in the same 
manner as the posttest. The child's task was to choose the flag 
which E named. Again, knowledge could not have bee ' 1 a factor with 
children of this age and background. Sets were arranged to provide 
maximal. similarity between the flags used in any single array and 
care was taken to avoid placing any single flag which, stood out 
from any of the others in its array. 
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FIND I NGS 

Tables 1 and 2 show the distribution of choices among the 
four positions for each subject on the pretest. Subjects whose 
choice pattern reveals a distribution of choices -/hick deviates 
significantly from chance by x 2 test (d.f. = 3) are ii:d heated by 

asterisks. 

Inspection of Table 1 indicates that 14 E ano 12- C subjects 
did not respond randomly. Hence, almost half the group tested 
evidenced positional response set behavior when linearly arranged 
patterns of four choices were presented and when knowledge was 
not a factor. 

Table 2 shows 10 K and 16 C subjects evidencing positional 
response set behavior. This proportion represents more than hal c 
of the group tested with four-choice items arranged in quadrants 
when knowledge was not a factor. 

Tables 3 and ‘4 show the distribution of choices among the 
four positions for each subject on the posttest. 

Inspection . of Table 3 shows 11 E and 14 C subjects with sig- 
nificant positional response sets. Therefore, compared to the pre- 
test, three less E subjects and two more C subjects showed signi- 
ficant positional response sets following training. 

Table 4 indicates 10 E and 15 C subjects showing significant 
positional response set behavior. Therefore, compared to the pre- 
test, eight less E and only one -less C subject showed significant 
positional response set behavior following training. 
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TA BLE 1 

p 

Pretest:: x and Frequency Distribution of Choices for Linear' 

E (Exp e rimo nta 1) and C (Control) Subjects for Each Position 



E 



Subject 
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b 
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* 16 
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* 1 
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13 
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• 10 
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* 24 
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10 
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* 14 
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2 
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11 
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.10 
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10 
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23 


11 


* 12 
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12 . 
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13 
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23 


14 
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4 


15 
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16 
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11 


3 . 


17 
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18 
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19 


* 18 
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20* 


* 11 
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21 


* 1 


18 
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22 


* 2 


10 


11 


23 
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24 
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25 - 
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11 


• 26 
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5 


27 . 


* 4.. 


12 
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28 


4 


7 


8 


29 


7 


8 


6 


30 


5 


’ 5 


4 


31 


3 


7 • 


10 


32 


* 0 


4 


17 



* x 2 ^ 7.82, p -‘C .05 
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TABLE 2 

p 

Pretest: ami Frequency Distribution of Choices for Quadrant 

„ E (Experimental) and C (Control) Subjects for Each Position 
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Subj ect a b c d 



1 


7 


8 


5 


4 


2 


* 0 


24 


0 


0 


3 


* 0 


0 


8 


16 


4 


* 4 


1 


11 


8 


5 


10 


6 


2 


6 


6 


6 


6 


8 


4 


7 


* 2 


21 


1 


0 


8 


6 


5 


8 


5 


9 


l * 0 
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7 


31 
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6 
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0 


1 


2 

x > 


7 - 82 s p 


<•05 
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0 


18 


k 
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TiuJLE 3 



Posl'l'GSt 


: x 


and 


Frequency Distri 


button 


of 


Choices for 


Line ax 


E 


(Exp e r irncntn 1) 
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(Control) 
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5 


6 


12 




8 


6 


4 


6 


12 




8 


4 


8 


13 


v: 


0 


0 


24 


0 


13 


V.' 


1 


' 7 


. 9 


14 




1 


6 


15 


2 


14 




6 


7 


2 


15 




14 


5 


2 


5 


15 


V.‘ 


10 


3 


6 


16 




4 


7 


3 


10 


16 . 




22 


1 


1 


17 




9 


6 


3 


6 


17 


k 


. 11 


6 


5 


18 




3 


11 


5 


5 


18 




3 


6 


8 


19- 


☆ 


10 


12 


2 


0 


19 




5 


9 


5 


20 


*A‘ 


6 


10 


S 


3 


20 




6 


5 


6 


21 


* 


1 


12 


8 


3 


21 


k 


0 


0 


0 


22 


* 


4 


10 


7 


3 


22 


k 


2 


14 


8 


23 




6 


4 


9 


5 


23 




11 


5 


6 


24 




5 


7 


8 


4 


24 


k 


9 


7 


8 


25 


' 


3 


7 


8 


6 


25 




5 


5 


7 


26 




8 


4 


6 


6 


2S 


k 


0 


24 


0 


27 


* 


5- 


7 


6 


6 


27 




14 


6 


1 


28 




7 


7 


4 


6 


28 




3 


7 


8 


29 




4 


14 


4 


2 


29 




1 


4 


13 


30 




10 


5 


7 


2 


30 . 


k 


0 


6 


13 


31 




5 


3 


10 


6 


31 




10 


8 


3 


32 


* 


6 


9 


6 


3 • 


32 




0 


7 


9 



* x 2 7.82, p .05 
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TAP LE 4 

Post Lest: x 2 and Frequency Distribution of Choices for Quadrant 
E (Experimental) and C (Control) Subjects fox- Each Position 

E C 



Subject 


a 


b 


e 


_ d 


1 




8 


7 


3 


6 


2 


* 


5 


9 


4 


6 


3 




5 


12 


0 


7 


4 


* 


6 


3 ' 


7 


8 


5 




7 


4 


5 


8 


6 




7 


7 


6 


4 


. 7 


* 


6 


14 


4 


0 


8 


, 


6 


6 


5 


7 


9 


I 

A | 


4 


3 


9 


8 


10 




8 


4 


1 


11 


11 


w 


8 


7 


5 


4 


12 




0 


14 


0 


10 


13 




4 


6 


6 


8 


14 




9 


7- 


5 


3 


15 


* 


0 


0 


24 


0 


16 




8 


5 


7 


4 


17 




5 


5 


8 


6 


18 




4 


8 


6 


6 


19 


V* 


4 


17 


1 


2 


20 




4 


0 


14 


6 


21 




8 


7 


5 


4 


22 




5 


3 


6 


10 


23 




6 


5 


8 


5 


24 


. 


5 


5 


11 


3 


25 


* 


8 


2 


11 


3 


26 




10 


7 


4 


3 


27 


. 


9. 


2 


9 


4 


28 


* 


3 


6 


5 


10 


29 




4 


8 


4 


8 


30 


* 


5 


2 


6 


11 


31 




13 


5 


6 


0 


32 




0 


24 


0 


0 



Subject 


a 


b 


c 


a 


i 


W 


6 


5 


2 


n 


2 




10 


4 


5 


5 


3 


* 


15 


0 


9 


0 


4 




1 


3 


6 


14 


5 




11 


4 


•8 


1 


6 


* 


8 


8 


2 


6 


7 




6 


7 


5 


6 


8 


* 


2 


5 


3 


> 14 


9 




7 


6 


3 


8 


10 . 


•t. 


7 


5 


4 


.8 


11 




6 


4 


6 


8 


12 


t?; 


2 


1 


9 


12 


13 


C; 


8 


16 


0 


0 


14 




8 


5 


8 


3 


15 


* 


8 


4 


7 


5 


16 




7 


6 


5 


6 


17 




4 


13 


/ 

7 


0 


18 


* 


0 


24 


0 


0 


in 


v; 


10 


9 


3 


2 


20 




6 


4 


9 


5 


21 




4 


6 


5 


9 


22 




2 


5 


9 


8 


23 




10 


■7 

t 


5 


2 


24 




3 


11 


5 


5 


25 




7 


8 


3 


. 6 


. 




0 


0 


14 


10 


27 


* 


12 


0 


7 


5 


28 


& 


0 


0 


24 


0 


29 




12 


0 


7 


5 


30 


v: 


0 


0 


24 


0 


31 




6 


5 


7 


6 


32 


* 


0 


0 


24 


0 



* x* ^ 7.82, p 



,05 
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TABLE '5 

Transfer Test: x 2 and Frequency Distribution of Choices for Linear 

E (Experimental) and. C (Control) Subjects for Each Position 



Subject 


a 


b 


O 


d 


Subject 


a 


b 


c 


d_ 


1 


1/ 


5 


5 


7 


7 


1 




5 


6 


10 


3 


2 




0 


4 


7 


13 


2 


£•* 


21 


1 


0 


2 


3 


k 


7 


3 


3 


11 • 


3 




8 


7 


s 


4 


4 




9 


2 


6 


7 


4 




4 


10 


s 


S 


S 


rk 


21 


0 


1 


2 


5 




3 


15 


2 


4 


6 




0 


1 


0 


23 


6 


☆ 


1 


5 


p 


9 


7 


* 


3 


6 


11 


4 


7 




11 


5 


5 


3 


8 




0 


,0 


14 


10. 


8 




5 


11 


7 ' 


1 


9 


rk 


4 


7 


4 


9 


9 


* ^ 


0 


24 


0 


0 


10 


& 


0 


0 


23 


1 


10 




4 


9 


5 


6 


11 


. .£* 


2 


12 


4 


6 


11 




8 


4 


5 


* 7 
# 


12 




10 


3 


5 


6 


12 




3 


11 


7 


3 


13 




0 


0 


24 


0 


13 


k 


7 


3 


. 9 


5 


14 




7 


8 


4 


5 


14 




8 


8 


2 


6 


IS 




8 


13 


1 


2 


IS 


k 


9 


8 


4 


3 


16 




11 


5 


5 


3 


16 




7 


2 


7 


■ 8 


17 




S 


2 


9 


8 


17 


k 


9 


13 


1 


1 


18 




7 


6 


9 


2 


18 




S 


2 


7 


10 


19~ 


•k 


1 


12 


11 


0 


19 




6 


9 


8 


1 


20 


* 


3 


13 


6 , 


2 


20 




2 


4 


10 


8 


21 


A 


3 


10 


6 


5 


21 


* 


0 


0 


0 


24 


22 


* 


3 


14 


6 


1 • 


22 




1 


0 


21 


2 


23 




5 


6 


8 


c, 


23 




S 


6 


7 


6 


24 




. 4 


4 


12 


4 


24 


k 


2 


6 


12 


4 


25 




4 


6 


6 


8 


25 




3 


S 


9 


7 


' 26 




1 


7 


7 


9 


26 


k 


0 


24 


0 


0 


27 


* 


4 


8 


4 


8 


27 




13 


S 


4 


2 


28 




4 


4 


7 


9 


28 




2 


6 


13 


3 


29 




8 


.12 


2 


2 


29 




9 


3 


4 


S 


30 




4 


6 


10 


4 


30' 


* 


0 


2 


18 


4 


31 




7 


6 


7 


4 


31 




7 


7 


9 


1 


32 


* 


2 


7 


10 


S 


32 




1 


6 


11 


6 


* x 2 


^ 7. 


82, 


p -OS 
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TABLE 6 



2 

Transfer Test: x and Frequency Distribution of Choices for Quadrant 

E (Experimental) and C (Control) Subjects for Each Position 

. E o 



Sub;] a 


Ct 


a 


b 


c 


d 


Subject: 


a 


b 


c 


d 


1 




8 


5 


o 


5 


i 


k 


0 


21 


0 


. 3 


2 


X 


7 


6 


5 


6 


2 




5 


3 


n 


5 


3 




5 


11 


0 


8 ' 


3 




7 


4 


9 


4 


4 




11 


5 


5 


3 


•i 




6 


1 


8 


9 


5 




11 


1 


8 


4 


5 




11 


7 


•4 


2 


6 


6 


6 


6 


6 


6 


‘A 


2 


11 


0 


11 


7 


* 


0 


21 


0 


3 


7 




6 


5 


6 


7 


8 




6 


. 6 


7 


5 


8 




5 


5 


5 ' 


9 


9 


$.* 


0 


11 


3 


10 


9 




5 


8 


2 


9 


10 




4 


7 


6 


7 


10 


V. 


6 


4 


4 


10 


11 


& 


8 


12 


2 


2 


11 




4 


8 


6 


6 


12 


■V.‘ 


14 


5 


3 


2 


12 


*k 


2 


0 


17 


5 


13 




13 


4 


3 


4 


13 


v.‘ 


24 


0 


. 0 


0 


14 




4 


5 


11 


4 


14 




4 


3 


4 


13 


15 




9 


3 


7 


5 


15 




2 


5 


9 


8 


16 


4 


8 


6 


6 


16 




7 


5 


8 


4 


17 




5 


3 


9 


7 


17 


* 


12 


6 


1 


5 


18 




7 


6 


5 


6 


18 


& 


2 


22 


0 


0 


19- 


i; 


10 


3 


7 


4 


19 


k 


2 


2 


1 


19 


20 


•k 


2 


1 


15 


6 


20 




7 


4 


7 


6 


21 




8 


10 


2 


4 


21 




7 


9 


3 


5 


22 




4 


11 


4 


5 


22 




10 


3 


8 


3 


23 




9 


6 


5 


4 


23 




8 


4 


8 


4 


24 




4 


4 


7 


9 


24 




5 


5 


5 


9 


25 


☆ 


2 


1 


9 


12 


25 




7 


‘ 5 


4 


8 


26 




9 


3 


7 


5 


26 


rk 


2 


q 


14 


4 


27 


•k 


7 


5 


7 


5 


27 


* 


2 


3 


9 


10 


28 


* 


5 


5 


6 


8 


28 


•k 


0 


0 


24 


0 


29 




10 


. 2 


10 


2 


29 




2 


5 


1 


16 


30 




2 


4 


6 


12 


30. 


rk 


5 


8 


2 


9 


31 


‘A* 


23 


1 


0 


0 


31 




7 


4 


4 


9 


32 


* 


3 


17 


0 


4 


32 


•k 


0 


0 


8 


16 



* x 2 E^- 7.82, p .05 
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TABLE 7 
7 

Pretest; x , Number and Percent Responses per Position for 





All Ss and 


for Ss with Significant Pretest Positional 
Response Sets Only 






Position A 


Position B 


Position C 


Position D 


x 2 


, -.P _ 


Linear: 














• 


All Ss 

03 = 6*0 


389 (25%) 


408 (27%) 


43S (29%) 


301 


(20%) 


27.10 


<.001 


PRS 3 s 
(N=26) 


174 (28%) 


171 (27%) 


193 (31%) 


86 


(14%) 


43*71 


<7.001 


Ouadrant : 
















All Ss 
(N=64) 


291 (19%) 


406 (26%) 


424 (28%) . 


415 


(27%) 


30.45 


<.001 


PRS Ss 
(N=34) . 


i 

124 (15%) 


231 (2S%) 


255 (31%) ' 


206 


(25%) 


47.71 


<.001 
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Tables 5 and 6 show the distribution of choices among the 
four positions for each subject on the transfer test. 

Tabic 5 shows that 14 E and 14 C subjects had significant 
positional response sets. This finding shows no gain for the E 
group from performance on the pretest. However , two more C sub- 
jects than on the pretest had significant positional response 
sets . 

Inspection of Table 6 indicates that 13 E and 13 C subjects 
showed significant positional response sets. Improvement from 
pretest performance is therefore present in both groups. Five less 
E and three less C subjects shov.^ed significant sets than on the 
pretest. 

Table 7 shows the x 2 , distribution and percent responses per 
position on the pretest for E and C subjects combined, E and C 
subjects are combined here due to .the fact that, since E and C 
treatments had not as yet been administered, treatment group was 
not considered a significant variable for analysis here. Also in- 
cluded are scores for subjects who showed significant positional 
response sets (PRS Ss.) . 

Both the linear and quadrant subjects evidenced significant 
positional response sets as groups. For the linear arrays the set 
seems to be characterized by a strong avoidance of the last posi- 
tion. The quadrant arrays are yielded a group set of similar mag- 
nitude characterized by .avoidance of the first or top left posi- 
tion. Regarding the PRS Ss alone, the same pattern is evidenced 
but emphasized for both array arrangements. In addition to these 
Ss, there seems to be a preference for the third position of .the 

O 

ERIC 




mear array ana ror tay ui. 






uadrant array. 

Table 8 shows the x 2 , distribution and percent responses per 
osition on the pretest for E and C subjects considered by sex. 
n the linear condition while male subjects could be characterized 
y having a group positional set female subjects could not be so 
haracterized. A larger proportion of males (15 of 32) than females 
11 of 32) evidenced significant sets. However, seven female PHS 
s did not exhibit a characteristic group effect, but rather 
xhibited more idiosyncratic behavior. In the quadrant condition, 
oth males and females exhibited an avoidance of the top left posi- 
ion. However, while males favored the bottom right position, fe- 
iales favored the bottom left position. Both male and female trends 
rere exaggerated when considering the PRS Ss alone. In the case of 
:he male Ss the group patterns seem to indicate a favoring, then, 

>f the right hand choices. 

Table S shows the x 2 , distribution and percent responses per 
josition on the pretest for E and C subjects considered by age. 
ill groups showed significant sets except the older Ss on the 
Linear array. In this case when PRS Ss are considered alone there 
Ls a significant set characterized by a favoring of the first and 
third positions in relation to the other two positions. The younger 
subjects show a strong avoidance for the fourth position and seem 
bo favor the- middle positions (second and third) in relation to 
the end positions (first and fourth). In the quadrant array, the 
older subjects showed a strong preference for the bottom right 
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T ABLE -8 

2 

Pretest: x . Number and Percent Responses per Position by 

Sex> for All Ss and. for Ss with Sigpnfieant Protest 
Positional Response Sets Only 

2 





Position A 


Position B 


Position C 


position D 


X 


J2 


Linear: 














All M 
(N=3 2) 


210 (27%) 


204 (27%) 


2 27 (30%) 


127 (17%) 


30.83 


‘<3.001 


All F 
CN=32) 


17 9 (23%) 


204 (27%) 


211 (27%) 


174 (2355) 


• 5.20 


NS 


PRS M 

0**15) 


105 (29%) 


111 (31%) 


120 (33%) 


24 ( 755) 


56.80 


<r.ooi 


PRS F 


69 (2655) 


60 (23%) 


73 (28%) 


. 6 2 (2 3%) 


1.67 


NS 


Quadrant : 














S ™ 

on 
i — 1 II 

H Sr 
< 0 


147 (19%) 


212 (2855) 


158 (21%) 


251 (3355) 


36.78 


<.001 


All F 
(N=32) 


144 (19%) 


194 (25%) 


266 (35%) 


• 164 (2155) 


. 45.87 


■C. 001 


PRS M 
(N-16) 


57 (15%) 


128 (33%) 


6 9 (18%) 


130 (3455) 


46.14 


<5.001 


PRS F 
(N“18) 


67 (16%) 


103 (24%) 


186 (43%) 


76 (1855) 


81 . 60 


<.001 
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TABLP. 9 



Prete 



st 



Age 



x 2 , Number and Percent Responses per Position by 
Group, for All Ss and for Ss with Significant- 
Pretest Positional Response Sets Only 



Position A Position B Position C Posit ion D 



2 

x 



£ 



Linear : 
All 66 + 



(N-31) 




187 


(25%) 


190 (26%) 


206 


All 65 
(Kl-33) 


- 


202 


(25%) 


218 (27%) 


23 2 


PRS 66 
CN= 9) 




64 


(30%) • 


45 (215Q 


66 


PRS 66 
(N=17) 


- 


110 


(27%) 


126 (31%) 


127 


Quadrant: 










All 66 
(N=25) 


+ 


122 


(20?0 


134 (2250 


130 


All 65 
0St=39) 


- 


169 


(1850 . 


2 7 2 (2950 


. 294 


PRS 66 

(N= 9) 


+ 


35 


(1650 


39 (1850 


45 


PRS 65 
•CN=25) 


- 


89 


(1556) 


192 (3 250 


210 



(2850 


161 


(2250 


5.61 


NS 


(29%) 


150 


(1950 


19. -58 


-<.001 


(31%) 


41 


(1950 


9.15 


-C.05 


(3150 


45 


(11%) 


44.26 


*<.001 



(2 250 


214 


(3650- 


36.92 


<C.001 


(3150 ' 


201 


(2150 


43 . 41 


<.001 


(2150 


97 


(M 550 • 


46.60 


•c.001 


(3550 


109 


(1850 


71.78 


<zz • ooi 
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position while the younger subjects acted quite differently , show- 
ing a strong preference for the bottom left position and a strong 



avoidance for the top left position. 

o 

Table 10 chows the x , distribution anci percent responses per 
position on the pretest for E and C subjects considered by sex and 
age group. In the linear array, it is clearly shown that the sex 
effect shown in Table 8 is not a function- of interaction with age. 
Neither female group exhibits a group PRS. The younger males shov; 
a much stronger group effect than do the older raales. In- the quad- 



rant array condition only the older females show no group PRS, henc 
the fact that on Table 9 older' g groups showed a significant set 
seems to be primarily a function of the older males. Interestingly, 
it is the younger females who shov; much more marked positional set 
than the younger males. The patterns for the four groups ware all 
quite different, the older females as mentioned before had no group 
effect; the older males seemed to favor' the bottom right position 
and avoid the top left position; the younger males shov;ed a strong 
preference for the top right position; the younger females showed 
an avoidance of the top left position similar to that of the older 
males and a preference for the bottom left position, a trend not 
characteristic .of any other c- .oup. 

Table 11 shows the means and S.D.'s bv treatment, array arrange 
ment and test period. Deviation scores are obtained by the follow- 
ing formula: JT(O-E) , where O = the obtained frequency of responses 

for any position* and E — the expected frequency of responses fa 
any position; since there are alvays four positions am 24 for test 
items , ’e was always equal to 4. The use of these deviation score? 
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tabu: 10 



Pretest: x‘~, Number and Percent Responses' per Position by 

Sex and Age Group for All Ss 4 





Position A 


position B 


Position C 


Position D 


2 

X 


P 


Linear: 






















M 6G + 
(N=13) 


93 


(3095) 


82 


(26%) 


84 


(27%) 


53 


(1795) 


11.69 


^ '<.01 


M G5 - 
(N=19) 


117 


(26%) 


122 


(2795) 


143 


(3195) 


74 


(16%) 


' 22.06 


' < .001 


F 66 + 
(N=18) 


94 


(22%) 


108 


(2595) 


122 


(2895) 


108 


(2595) 


3.62 


NS 


F 65 - 
(N=14) 


85 


(25%) 


96 


(2995) 


89 


(2695) 


. 66 


(2095) 


4.31 


NS 


Quadrant : 






















M 6G + 

(N=mo 


48 


(14%) 


69 


(2195) 


71 


(2395) 


142 


(4295) 


58.74 


<.001 


M 65 - ' 

(N— 18) 


99 


(2395) 


143 


(3395) 


81 


(199') 


10 9 


(2595) 


18.85 


<.001 


F Or + 
<N»il) . 


•_ V 


(28%) 


65 


(2595) 


53 


(20%) 


7 2 


(27%) 


4.18 


NS 


F 65 - 
(N=2l) 


70 


(14%) • 


129 


(2695) 


213 


(4295) 


92 


(1895) 


94.20 


<.001 



4 Distributions for Ss with significant positional response se L s only are not 
included in this table because of the small Ns involved # 
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enubled us to express the amount of TRS behavior quantitatively « 

In Table 11, we note that, on the protest^, the aver act c devia- 
tion score (DS) for each g roup , with the exception of the E quad- 
rant group , wc.s between 13 and 14, The rQ group obtained a mean D3 
of 16.12. On both the post and the transfer tests, both L groups 
obtained lower mean scores than their respective C groups. 

These scores were tested for significance by a three-way analysis 
of variance (Treatment x Array Arrangement x Test Period) . The 
hypothesis tested was that the interaction between treatment and 
test period should be significant in that while the E and C groups 
should be equal at pretest, the E group scores should drop signi- 
ficantly on the post and transfer tests. The only significant effect 
obtained was the above interaction. From Table 11 wo see that the 
significant interaction occurred as predicted. On the pretest, the 
E scores were generally lower than the C scores, v.’hile on uhe post 
and trans -r tests, the opposite was true. 

Table 13 shows the means and S.D.'s of deviation scores by 
treatment, sex and test period. 

Scores were tested to see whether sex, either alone or in inter- 
action with treatment and/or test period had a significant effecu on 
the results . (Table 14). Again, the only significant effect was the 
treatment x test period interaction. 

Table 15 presents the means and S.D.'s of the deviation scores 
by treatment, age. group, and test period. The. Ss were divided into 
two groups within each treatment condition as to whether they were 
66 months of age and above or 65 months of age and belovr. 
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TABLE 11 

Means and Standard Dev 1 ations 
of Deviation Scores by Treatment, Arr " 

Arrangement and Test Period (n = 32) 

Pretest Posttest Transfer 







A 


S * D * 


X 


S.D. 


X 




E 


Linear 


13.81 


9.32 


12.09 


10,38 


13.50 


9.17 


E 


Quadrant 


1G . 12 


10.50 


11.12 


8.32 


11.06 


8.29 


C 


Linear 


13.34 


9.79 


13.06 


9.59 


14.12 


9.38 




Quadrant 


13.59 


10.46 


14.0 0. 


10.40 


13.88 


9.32 
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TABLE 3.2 



Three-Way Analysis of Variance with 
Repeated Measures of Deviation Scores 
(Treatment x Array Arrangement x Test Period) 



Source 



Between Ss 

A "(Treatment) 

B (Array Arrangement) 
'AB 

Ss within groups' 

Within Ss 

C ’’("Tent Period) 

AC 

BC 

ABC 

CxSs v/ithin groups 



SS 


df 


MS 


F 


- 


12 7 






48.88 


1 


48.88 


cl 


.06 


1 


.06 


<1 


11.00 


1 


11.0 0 


<1 


25648.18 


124 

383 


206.84 ■ 




379 . 41 


2 


89.70 


•• 2.81 


235.85 


2 


117.92 


3. 69 


110.24 


2 


55.12 


1.73 


71.65 


2 


35.82 


1.12 


7918 . 85 


248 


31.93 







•leans and Standard Deviations of 



Deviation Scores 





Sex 


and t’esl 




Pretest 




X 


S , D . 


E Males 


15.19 


9.95 


E Females 


1-1,75 


10.03 


C Males 


13.69 


10.43 


C Females 


13.25 


9.65 



by 1' r e a tine n t , 
iod (n = 32) 



Posttest Transfer 



X 


s , p . 


X 


S.D. 


12.69 


8.89 


13.50 


9.30 


10.53 


9.08 


11-.06 


7.84 


13.44 


9.71 


13.25 


9.07 


13.63 


10,15 


14.75 


9.57. 
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TA BLD 14 

Three-V.'ay Analysis of Variance with 
Repeated Measures of Deviation Scores 



(Treatment 


x Sex x 


Test Period) 




Source 


SS 


d£ 


MS 


F 


Re tween Ss 




12 7 






A (Treatment) 


4 8 .• 8 8 


1 


48.88 


c 1 


B (Sex) 


38.13 


1 


38.13 




AB 


105.20 


1 


105.20 • 


-c: i 


Ss .. v:i thin . groups 


25515.91 


124 


205.77 


<7 1 


Within Ss 




256 






C (Test Period) 


179.41 


2 


89 .70 


2 . 77 


AC 


235.85 


2 


117.92 


3.64 


H C 


6.03 


2 


3.02 


<r 1 


ABC 


62.78 


2 


31.39 


<7 i 


CxSs v/ithin groups 


8031.93 


24 8 


32.39 
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T /iBL E 15 

Ms, Means and Standard Deviations of 









Deviation Scores 


1 j r Treatment , Acje 












Group and ' 


Pest Period 












Pretest 


Post test 


Trans 


f cr 






n 


X S.D. 


X S.D. 


X 


S.D. 


E 


6 6-b 


29 


12.48 9.76 


11.69 9.44 


10 . 69 


7.37 


E 


65- 


35 


.17.03 9.69 


11.54 8.89 


13.60' 


9. *«3 


c 


6 6* 


27 


11.96 10.15 


11.33 8.54 


12.74 


s . so 

> 


C 


65- 


37 


14.57 9.97 


15.14 10.67 


14.92 


8.90 
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Table 16 
tain whether 
and/or test p 



shows the analysis of variance calculated to as cor- 
ag e t cither singly or in .interaction with treatrrent 



erica , 



j.canv. 



factor, Agn: 



or.lv the 



treatment 
level of 



x test period interaction reached an acceptable (p <.05) 
ianificri.ee The main effect of age did not quite reach 



this level. 
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TABLE 1G 



Three- 1 /.’ ay 


Analysis of 


Variance with 




Repeated M 


easurcs of D 


eviation 


Scores 




(Treatment 


x Age Group 


x Test 


Period) 




Source 


SS 


of 


MS 


F 


Betv;een Sc 




127 






A (Treatment) 


34.74 


' 1 


3 4.74 


-Cl 


B (Acre) 


666.02 


1 


666 . 02 


3.06 


-AB 


.14 


1 


.14 


<1 


Ss within- groups ' 


26993.93 


124 


217.69 


• 


Within Ss ' • ' 




25 6 






C (Test Period) 


162.95 


2 


81.48 


2 . 56 


AC 


207. BO 


2 


103.90 


3.27 


BC 


48.95 


2 


24.47 


Cl 


ABC 


153.48 


2 


76.74 


2 . 41 


CxSs v.’ithin groups 


7898.10 


248 


31.85 
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CONCLUSION S 



1. This research has shown that positional response set be- 
havior occurs with great frequency among preschool age, disadvan- 
taged children , and. that this behavior is subject to inod.il ication 
by training. 

Of the Ss tested, 40% of those exposed to linear (left to 
right) arrays exhibited PRS behavior, while over 50-o of tnoce ex- 
posed to quadrant arrays showed PRS tendencies. 

2. When scores are combined , it can be seen that character- 
istic group patterns emerge. When exposed to linear arrays, PRS 
is characterized by a relative avoidance of the fourth or right- 
hand most position. When the stimuli are arranged in quadrant pat- 
terns, group avoidance is shown for the first cr upper-left position 

Considering only PRS Ss , we may also conclude that, with linear 
arrays, there is a preference for the third position. With quadrant 
arravs , preference is also for the third, but in this case bottom— 
left, position. 

3. Sex of the subject appeared to. have some effect on the 
patterns obtained. With linear arrays, while males reflected the 

■ trend cited in (2) , females were quite idiosyncratic and did not 
display a distinctive group pattern. With quadrant arrays, both 
males and females displayed the characteristic avoidance of the 
top— left position, but preferences differed. Rales tended to choose 
positions on the right, whether upper or lower, while females 
showed a strong preference for the bottom-left position. 
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4. Age seemed to strongly influence the probability of 
occurence of PRS Ss , While about one— tiiird of Ss, 6 6 months of 
age and above were PRS Ss, over 50S of those Ss, 65 months of age 
and below, showed significant sets. VJith linear arrays, while tne 
PRS Ss in both age groups tended to avoid the fourth position and 
favor the third position, the younger children seemed to also pre- 
fer' the second position. With quadrant arrays, both age groups, 
with the exception of the older females, show the top— left position 
avoidance, but the older Ss showed a strong preference for the 
lower -right position, while the younger female Ss showed a strong 
preference for the bottom.- left position. The younger males showed 

a preference fdr the top-right position. 

5. By utilizing a procedure in which Ss were given training 
in scanning arrays similar in pattern to the test arrays, guessing 
patterns were significantly altered in relation to patterns of 
groups not similarly trained. By training Ss to scan arrays properly, 
i.e„, to look at each position, and by showing them that. a correct 
answer could occur in any of the four positions, substantial chancre 

in behavior occurecl, y 

6. The training procedures adopted in this research, which 
succeeded in changing choice patterns in regard to the Chinese 
Letter Naming Task, also succeeded in transferring the benefit to 
a situation utilizing the same array patterns, but different 
stimuli (flags) . 
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RE COl ?tf 15K DAT I ON S 



1, Further research should be undertaken with respect to the 
following related problems: 

a 0 ) To determine the generality of the findings regarding the 
degree and pattern of positional response set behavior with cnild— 
ren of other background and SES characteristics. 

b. ) To determine whether PRS behavior rs a function of scan- 
ning. PRS Ss should be examined as to eye movement patterns in re- 
lation to. eye movement patterns of good scanners. 

c. ) ;To develop methods to produce more extensive changes in 
test-related scanning skills c 

d. ) To determine the extent and pattern of positional response 
sets with other array arrangements and sizes. 



2. The results of our investigation imply that positional sets 
are verv common amona low SES preschool— age chilare Since thrs 
behavior may reflect the lack of adequate scanning 1 these child- 
ren, these findings have important implications for treschool pro- 
grams, especially .in reference to prereading skills and test-taking 
skills. It is possible that low scores on tests by these children, 
•when such tests involve multiple choice, may reflect not so much a 
cognitive deficit, but, rather, an inadequate registration of the 

— v 

choices offered. If a child is not adequately registering informa- 
tion apoearing on a page, then reading cannot take place. Percep- 
tion must precede cognition. 
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3. Given the problem outlined above , remedial stops , can be taken, 
and should be incorporated into preschool curricula. A step in 
this direction could be more extensive use or some adaptation of 
the training methods utilized in the current study. The method has' 
the advantage of training the children to look at all of the choices 
in a manner which reinforces the correct scanning patterns for 
reading in the English language , that . is , from, left to right. It 
should be pointed out that our training did not produce a strong 
enouqh change insofar as changes in number of F RS Ss« Hot’ ever , dis~ 

J r 

tributed practice over a longer period of time could produce the 
desired change. After all, our 'training period entailed only on*-, 
ten minute sess.ion. 



4. Test users and constructors should be aware of PRS. One tech- 
nique used by this investigator in the Early Chilcthood Inventories 
(Coller and Victor, 1967)., is to utilize a second form of a test 
in which the same choices are given, but their positions changed. 

If a child is correct on both, we can be reasonably sure that the 
answer is known.. This procedure is desirable for diagnostic testing. 
Other procedures night utilize some instructional procedures to 
emphasize to the children the need for looking at all choices, A 
sliding window technique, for example, could, be used for sample 
items prior to the test, 

.x ' • 
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APPENDIX 



A. CHINESE LETTERS - Linear Array 

B. CHINESE LETTERS - Quadrant Array 

C. TRAINING FIGURES - Linear Array 

D. TRAINING FIGURES - Quadrant Array 

E. CONTROL FIGURES - -Linear and Quadrant Arrays 

F. FLAGS - Linear Array 

G. FLAGS - Quadrant Array ^ 

H. Answer Sheet ■ 

I. SLIDING WINDOW ~ Linear Array 
j. SLIDING WINDOW - Quadrant Array 
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Boxes surrounding the figures were deleted in the test version. • ! 
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TRAINING FILUKES. - Linear Array 





CONTROL FIGURES - Linear and Quadrant Arrays 




Boxes surrounding the figures were deleted in the test version. 
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FLAGS - -Linear Array 














'&S 






y * V rcA 




■f 

ftf 




.YdA'.V 



"1 

I 



1 




. rr — 



,k 






FLAGS - Quadrant Array ‘ 





b ! v 



. j 




• 'uVU s. (A) 



<~y 





POSITIONAL RESPONSE TEST 



5.0 

DOl 



LINEAR 

QUAD 

Flags 



y 



CONT 



-test 



a 

a 

a 

a 

: a 
: a 

3. 

'■ a- 



b 

b 

b 

b 

b 

b 

b 

b 



c 

c 

c 

c 

c 

c 

c 

c 



Training 



d 

d 

a 

a 

a 

a 

a 

a 



TOTAL 



□ □□□ 



Training II 



Post Test 



3. 


b 


c 


a 


l. 


a 


b 


c 


a • 


i- . 


. a ^ 


b 


c 


a. 


3. 


b 


c 


a 


2. 


a 


b 


c 


a . 


2. 


a 


b 


c 


a 


a 


b 


c 


a 


2a . 


a 


b 


c 


a 


3. 


cC 


b 


c 


a 


a 


b 


c 


d 


3. 


a 


b 


c 


a 


. 4. 


a 


b 


c 


a 


a 


b 


c 


a 


4. . 


a 


b 


c 


a 


5. 


a 


b 


c 


a 


a 


b 


c 


a 


5. 


a 


b . 


c 


a 


6. 


a 


b 


c 


.'a 


a 


b 


c 


d 1 


5a. 


a 


b 


c 


a 


7. 


a 


.b 


c 


a 


a 


•b 


c 


a | 


6.' 


a 


b 


c 


a 


8. 


a 


b 


c 


a 


a 


b 


c 


a 


7. 


a 


b 


c 


a 


9. 


a. 


b 


c 


a 


a 


b 


c 


a 


8. 


a 


b 


c 


a 


. 10. 


a 


b 


c 


a 


a 


b 


c 


a 


8a. 


a 


b 


c 


a .. 


11- ' 


a 


b 


c 


a 


a 


b 


c 


a 


9. 


a 


b 


c 


a/ 


12 


a 


b 


c' 


a 


a 


b 


c 


a 


10. 


a 


b 


c 


a 


13. 


a 


b 


c 


a 


a 


b 


c 


a 


11. 


a 


b 


c 


a 


14. 


a 


b 


Vp* 


a 


a -> 


b 


c 


a 


lla 


# Sl 


b 


c 


a 


15. 


a 


b 


c 


a 


a 


b 


c 


a 


12 . 


a 


b 


c 


a 


16. 


a 


b 


c 


a 



17. 

18. 

19 . 

20 . 
21 . 
22 . 



a 

a 

a 

a 

a 

a 



b 

b 

b 

b 

b 

b 



c 

c 

c 

c 

c 

c 



a 

a 

a 

a 

a 

a 



1. Phill . 


a 


b 


c . 


d 


2. Belg. 


a_, * 


:b . 


c 




' 3'. Denmk . 


a 


b 


c 


"a 


4. Chad. . 


a' ^ 


b 


c 


a 


5 . Cameroon 


a 


b ' 


c 


a 


6 . Iraq 


a 


b 


c 


d 


‘•7. Neth. 


a 


b 


c 


d 


S. Nicarg. 


a 


b ' 


c 


d 


S . Roumania 


a ■ 


b 


c 


d 


. 10 . Ethiopia 


a 


b 


c 


d 


11. Burma 


a 


b 


c 


d 


12 . Morocco 


a 


b 


c 


d 


13.Aust. 


a 


b 


. -• 


' d 


14 . Ghana 


a 


b 


c 


a 


15 . Malaya 


a. 


b 


c 


d. 


. 16 . Panama 


a 


b. 


c 


d 


17 . Czech . 


a 


b 


c 


d 


1 8 . Cabon . 


a 


b 


. c 


d- 


19 .No rw ay 


a 


b 


c 


d 


20 . Guinea 


a 


b 


c 


d 


21. Mali 


a 


b 


c 


d 


22 * Yemen 


a 


b 


c 


d 


2 3 . Hungary 


a 


b 


V 


6 


24 . Parag. 


a 


b 


c 


.'d 



!□□□ 



0 

ERIC 



1. a 


b 


c 


d 


23/ 


a b 


c 


d TOTAL 


2 . a 


b 


c. 


d 


24. 


a b 


c 


d 


2a. a 
3 . a 


b 

b 


c 


d 

a 


TOTAL 


□□ 


□ 


U ; 


4 . a 


b 


c 


. d 






5 . a 


b 


c 


d 






. ' 




5a. a 


b 


c 


d 










6 . a 


b 


o 


d 




r 






7. a 


b 


c 


d 






- 


* 


8. a 


b 


c 


d 










8a. a 


b 


c 


. d - 








•. * 


9. a 


b 


c 


d 










10. a 


b 


c 


d 




. 






11. a 


b 


c 


d 




v. . ’■ 






lla. 


b 


c 


d' 








. ■ -r \ . 


12 . a 


b ’ 


c 


d . f 











□nor 



**«■ □□□□ 



72 





